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(57) ABSTRACT 

A digital video camera is coupled with an image processing 
station by a tether that has a bandwidth. The processing 
station has a memory with a program that executes instruc- 
tions. When application software on the station requests a 
driver on the station to operate the camera at a specific frame 
rate, the program determines whether the requested frame 
rate is higher than permitted by the tether bandwidth. If that 
is so, the program computes a maximum permitted frame 
rate and an integration time of the pixels of the camera. The 
integration time causes the camera to produce output video 
frames at a rate commensurate with the computed bandwidth 
constrained frame rate, instead of the requested frame rate. 
The program then adjusts the gain accordingly. 

15 Claims, 2 Drawing Sheets 
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IMAGER LINKED WITH IMAGE DETAILED DESCRIPTION 

PROCESSING STATION Alternate embodiments of the invention may provide a 

system, software, and a method for controlling operating 

BACKGROUND parameters of a digital video camera that is coupled with an 

5 image processing station via a communication link, 

1. Field although, of course, the invention is not thus Limited in scope 
This disclosure is related to the field of imaging. io this respect. 

2. B ackground of the Invention Briefly the invention determines when the requested video 
When a digital video camera is aimed at a scene, it in frame rate is larger ^than the frame rate permitted by the 

generates image data corresponding to the scene. Ihe image 10 tmited bandwidth of the bnk If that is so, the invention^ may 

data is then processed to produce an image of the scene. 861 * 6 ^tegrauon time in such a way that the resulting frame 

An effort is made lo improve the quality of the eventual " te » m T^?* ™* a »™» *™* 

* ,. j V j- *• c»l ^ by the link. The invention may thus optimize the Signal to 

image. The effort is made by adjusting some of the operating x , . „ , . /c . Km \ , , , , ^ T . °. 

. r j- i . . o *~ ~y Noise Ratio (SNR), which also optimizes Image quality, 

parameters of the digital video camera. Some adjustments 15 *. - . '\, . , i. 

are made by the user, and some automatically by the camera. ***>™g to FIG. 1. an erttdml of a system according 

_ . . , * . , . A to the invention is now described. The system includes an 

Ttese operating parameters may include the p*el intc- ^ ^ ^ ^ ^ ^ u0 ^ te 

erauon time, the gain, and the frame rate. 1*e camera fIooesaiag mt3on llOcai comprte. for example, a special 

exposure parameters are the integration time and .be gaui. ^jwe ^ d ^ d) . vfce J ted £ r me 

These parameters may be .ntertelated. For example, the 20 A ^ 

integration time is currently determined, at east in part, by ^ ' £ ^ a * ^ coulter, in which case the 

the luminance of (he scene. If a scene starts becoming ^ ^ fc b/softw^. 

darker, the camera might correct for it by increasing the JZ. . . ... . . . . . 

integration time This particular embodiment can be used with an imager, 

■ . . such as digital video camera 120. Here, camera 120 takes 

There are a number of catena used to determine video 25 icmrcs of ft &ame &ize ^ xhe frame ^ is a 

image quality. One criterion a ithe video frame rate (the mnclion of ^ ^ ^ aQd ^ ima ^ d ^ The im 

higher the frame ratA the higher the quality) Another size is the total numbers of ixels , For CXBm { camera ^ 

cnterion is noise. Tie kwertbe nose, the higher the image can haye ^ ^ ^ of 640 ^ ^ b 4g0 ^ 

^V^"^ ^.^u- If^c^l 0156 RaU ° 3Q bigh- Hie image depth is a term of art for describing how 

(SNR) (the tower the noise, the higher the SNR). 30 m£my ^ ^ ^Ucd to dcscribc tbc value of ^ dala 

Often these two criteria are at odds. A higher frame rate of eacn pixeL ^ typical number might be 16 bits per pixel. 

requires a shorter integration time (and thus also a higher ] n case> lne fr ame s j ze (pg) therefore equals 640x480x 

gain), which results in more noise (lower SNR). Achieving J6 . Of course, any frame size may be employed in an 

a higher SNR often requires a longer integration time, which alternative embodiment. 

in turn lowers the frame rale (and also requires lower gain). 35 Camcfa 12Q fa to image processing stalion 110 by 

In some situations, an image processing station is tethered a communication link 130, which is also known as a data 

to, and made to operate with, the digital video camera. The gu i<fc or simply a pipe. In the case of FIG. 1, the commu- 

camera generates and simultaneously transfers the image nication link 130 comprises a cable, coupled to station 110 

data to the image processing station over the tetber, which at a port 140. Port 140 can comprise a Universal Serial Bus 

can be a data cable. This is referred to as a linked digital (USB) port. 

video camera. The communication link 130 can comprise any link, such 
Additional parameters may be adjusted in the situation as an infrared link, radio link, telephone line, Ethernet 
where a digital video camera is linked. Some of these connection, or other data transfer link. In addition, the link 
additional parameters are typically controlled by special 4J 130 can include a number of concatenated legs. For 
software residing in the image processing station, sometimes example, data might even pass through a network, such as 
called the camera client. One of these parameters is the t ae Internet, before reaching station 110. 
frame rate of the image data flowing through the commu- The article of the invention also has a storage medium, 
nication link. In many instances, the frame rate is not 5UCD as a computer readable storage medium, and a corn- 
controlled directly, but only indirectly. $Q putin& device, such as a processor or controller, that can 
Sometimes the camera client requests the camera to interact with the storage medium. The storage medium has 
transmit data at a specific frame rate. A digital video camera stored thereon instructions of a program that can be executed 
will attempt to deliver the frame rate requested by the by the computing device. In the embodiment of FIG. 1, the 
camera client. Sometimes the requested frame rate is faster image processing station 110 has a memory 150 and a 
than can be accommodated by the bandwidth of the com- SJ Central Processing Unit (CPU) 160. 
munication link. The requested frame rate will consequently The detailed description that follows is presented largely 
not be provided. in terms of display images, algorithms, and symbolic rep- 
Hie invention will become more readily apparent from resentan'ons of operations of data bits within the computer 
the following Detailed Description, which proceeds with readable medium. These algorithms descriptions and rep re - 
reference to the drawings, in which: go sentations are the means used by those skilled in the data 

RRfPF nT^rBTPTTON OP TUP nRAWnsrn<5 processing arts to most effectively convey the substance of 

BRIEF DESCRIPTION OF THE DRAWINGS lheir wQrk iQ othere b , he m A ^ Ujc 

FIG. 1 is a block diagram of an embodiment of a camera art of programming can use this description to readily 
that has a communication link with an image processing implement specific instructions for a program according te- 
station via a data cable in accordance with the invention. 65 the present invention. 

FIG. 2 is a flowchart illustrating an embodiment of a Often, for the sake of convenience only, it is preferred lo 

method according to the invention. implement and describe a program as various interconnected 
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distinct software modules or features, also known as soft- 
ware. This is not necessary, however, and there may be cases 
where modules are equrvalently aggregated into a single 
program with unclear boundaries. 

In any event, the software modules or features of this 
embodiment can be implemented by themselves, or in 
combination with others. Again, the combination can result 
in distinct software modules, or ones with blurred bound- 
aries. 

An algorithm Is here, and generally a self consistent 
sequence of steps leading to a desired result. These steps, 
also known as instructions, are those involving physical 
manipulations of physical quantities. Usually, though not 
necessarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, 
combined, compared, and otherwise manipulated. When 
stored, they can be stored in any computer-readable 
medium. It is convenient at times, principally for reasons of 
common usage, to refer to these signals as bits, values, 
elements, symbols, characters, images, terms, numbers, or 
the like. It should be borne in mind, however, that all of these 
and similar terms are associated with the appropriate physi- 
cal quantities and are merely convenient labels applied to 
these quantities. 

In one embodiment, the method of the invention is 
implemented as machine operations optionally performed in 
conjunction with a human operator. Useful machines for 
implementing the method include general purpose digital 
computers, the image processing station 110, the camera 
120, or other similar devices. There should be borne in mind 
the distinction between the method of operating a computer 
and the method of computation itself. This embodiment 
relates to method steps for operating a computer and pro- 
cessing electrical or other physical signals to generate other 
desired physical signals. 

As described above, another aspect of the invention also 
relates to apparatus for performing these operations. This 
apparatus may be specially constructed for a specific 
purpose, or it may comprise a general purpose computer 
selectively activated or reconfigured by a computer program 
stored in the computer. The processes presented herein are 
not inherently related to any particular computer or other 
apparatus. In particular, various general purpose machines 
maybe used with programs in accordance with the teachings 
herein, or it may prove more convenient to construct more 
specialized apparatus to perform the required method steps. 
The desired structure for a variety of these machines will 
appear from the description given below. 

The program of the invention can be stored in a computer- 
readable medium, such as a computer memory, a 
microprocessor, etc But it should be clear to a person skilled 
in the art that the program of this embodiment need not 
reside in a single memory, or even a single machine. Various 
portions, modules or features of it can reside in separate 
memories, or even separate machines. The separate 
machines may be linked directly, or through a network, such 
as a local access network (LAN), or a global network, such 
as what is presently known as Intemet-1. Similarly, the users 
need not be collocated with each other, but each only with 
a machine that houses a portion of the program. 

An adaptable station 110 can run such a program for any 
camera to which it is linked. The program outputs at least 
one operating parameter for driving the camera 120. Any 
event may trigger running the program, such as requesting 
a new frame rate. The request can be generated externally, 
or internally by the program. The request can be made any 
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time. A new request can be looked for at any lime, such as 
at video capture start, or when a reconnect is detected after 
a disconnect at a port 140 of station 110. 
In the embodiment of FIG. 1, the program can include two 

5 components. The first component is an application software 
170 called the camera client. The second component is a 
camera driver 180. Other components, also known as layers, 
may be interposed between the application software 170 and 
the camera driver 180. 

10 The program of the invention includes software for com- 
puting a bandwidth constrained frame rate (BCFR) from a 
frame size (FS) of the video camera, and a bandwidth (BW) 
of the link. Computation may be according to Equation (1) 
below. 

15 

BCFfrBW?[FSxCJi] Equation (1) 

where CR is the compression ratio. If there is no image 
compression, then CR may be set equal to one. 

20 The program additionally includes software for determin- 
ing whether the computed BCFR is smaller than a requested 
rate of video frames from the camera,* and if so, for deter- 
mining an integration time of pixels of the camera from the 
computed BCFR. 

25 In one embodiment, the software for determining the 
integration time results in an integration time determined 
such that the camera outputs video frames at a rate com- 
mensurate with the computed bandwidth constrained framo 
rate. In other words, the integration time is computed such 

30 that the resulting video frame rate is the largest possible that 
the bandwidth of the link will permit. For example, if the 
BCFR is computed at L5 frames per second, then the 
integration time becomes Yis^ sec. 
It will be appreciated that making the actual video frame 

35 rate commensurate with the BCFR is accomplished by 
maximizing the integration time. This minimizes noise, 
which optimizes image quality. 

In some instances, where the target scene is very bright, 
the integration time may not be brought as high as the 

40 computed BCFR dictates. In any event, the SNR is still low. 
In one more embodiment, the software for computing the 
BCFR may use a compression ratio of the video camera. 

In a specific embodiment, the software for detennining an 
integration time computes a numerical inverse of the com- 

45 puted bandwidth constrained frame rate. The inverse may be 
used for determining an integration time threshold (ITT). 

In an embodiment of the invention, the program further 
includes software for determining a gain of the camera from 
the determined integration time. The gain thus determined 

SO compensates for the adjusted integration lime. 

In some embodiments according to the invention, there 
may be predefined, associated values of integration time and 
gain, which may further correspond to luminance. They 
many be associated explicitly, such as by being stored in a 

55 memory as a look up table with indices. Or they may be 
associated implicitly and indirectly, as values that result as 
pairs from sets of instructions that search through successive 
steps. 

In all these cases, the invention may operate by tempo- 
60 rarily constraining the choices of the camera, while allowing 
it to operate regularly otherwise. For example, the invention 
may temporarily disable a portion of the table with integra- 
tion times less than the determined integration time thresh- 
old (ITT). Or it can reject results from instructions that 
65 render too low integration times. 

Given tbe above, the instructions stored on the medium, 
when executed by a computing device, result in computing 
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a bandwidth constrained frame rate (BCFR) from tbe frame 
size of tic video camera 120 and the bandwidth of tbe link 
130. The instructions additionally determine whether tbe 
computed BCFR is smaller than a requested rate of video 
frames from the camera, and if so, further determine an 
integration time of pixels of the camera 120 from tbe 
computed BCFR. 

In an embodiment, executing the instructions may addi- 
tionally result in the determined integration time to be such 
that the camera outputs video frames at a rate commensurate 
with the bandwidth constrained frame rate. 

Executing the instructions may also result in the band- 
width constrained frame rate to be computed also from a 
compression ratio of the video camera. 

In an embodiment, executing tbe instructions may result 
in the computing a numerical inverse of tbe computed 
bandwidth constrained frame rate. 

Executing the instructions may further result in determin- 
ing a gain of tbe camera from the determined integration 
time. 

Embodiments of methods for computing operating 20 
parameters in a digital video camera in accordance with the 
invention include tbe following. In these embodiments, the 
camera is linked with an image processing station by a 
communication link, which has limited bandwidth. 

Referring now to FIG. 2, a representative method of the 25 
invention is described. References are made to components 
of this embodiment in accordance with tbe invention as they 
appear in FIG. 1. In addition, it will be appreciated that FIG. 
2 can also serve as a flow chart of a software according to 
the invention. 30 

According to box 210, a frame size FS of an imager such 
as the digital video camera 120 is set or determined. This can 
be by the camera client, either by inquiry or be a prepro- 
grammed value. 

According to box 220, a compression ratio CR of the 3S 
digital video camera 120 is determined. This is performed if 
a compression feature is provided. The program generally 
knows in advance if the feature is provided, and if so, its 
value. Alternately, it can be determined by a query. 

According to box 230, a bandwidth BW of the commu- 40 
nication link 130 is determined. If the port 140 includes a 
USB type connection, then the bandwidth is known. The 
bandwidth could change, e.g. if tbe link were through the 
internet. In the latter case the bandwidth may be queried, and 
the program can adjust the frame rate dynamically. 

According to box 240, a bandwidth constrained frame rate 
BCFR is computed from the determined bandwidth BW and 
frame size FS. Computation can be as taught in Equation (1). 
Although alternative approaches are also available, the com- 
putation can also include the compression rate CR, if a 
compression features is provided If not, then CR is set equal 
to 1 in Equation (1) in this embodiment. 

According to box 250, a requested frame rate is input. It 
can be requested by the camera client, at power up or other 
lime. Or it can be input externally, at any time. 

According to a box 260, it is determined whether the 
requested frame rate is larger than the bandwidth con- 
strained frame rate BCFR. If not, then the request is hon- 
ored. If it is larger, however, then an integration time of 
pixeb of the camera is determined from the computed 60 
bandwidth constrained frame rate. In some embodiments, 
the integration time is determined with a value that results in 
the camera outputting video frames at a rate commensurate 
with the bandwidth constrained frame rate. In one of those 
embodiments, execution proceeds from box 260 to box 270. 

According to box 270, an integration lime threshold 11 1 
is determined. It can be computed as a numerical inverse of 
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the bandwidth constrained frame rate BCFR, although the 
invention is not limited in scope in this respect. 

According to box 280, an integration time for the digital 
video camera 120 is set at a value at least as large as the 
determined integration time. It can be one of a set of preset 
acceptable values, or found by gradual adjustment. 

According to an optional box 290, an updated gain value 
is determined from the determined integration time. This can 
be performed in a manner similar to what was described 
above. The operations of boxes 280 and 290 can take place 
concurrently. 

Tne values can then be output to drive the camera 120. 

A person skilled in the art will be able to practice the 
present invention in view of the description present in this 
document, which is to be taken as a whole. Numerous details 
have been set forth in order to provide a more thorough 
understanding of the invention. In other instances, well- 
known features have not been described in detail in order not 
to obscure unnecessarily the invention. 

The specific embodiments thereof as disclosed and illus- 
trated herein are not to be considered in a limiting sense. 
Indeed, it should be readily apparent to those skilled in the 
art in view of the present description that the invention can 
be modified in numerous ways. The inventor regards the 
subject matter of the invention to include all combinations 
and subcombinations of the various elements, features, 
functions and/or properties disclosed herein. 

Tbe following claims define certain combinations and 
subcombinations, which arc regarded as novel and non- 
obvious. Additional claims for other combinations and sub- 
combinations of features, functions, elements and/or prop- 
erties may be presented in this or a related document. 

What is claimed is: 

1. A method comprising: 

computing a bandwidth constrained frame rate from a 
frame size of an imager and a bandwidth of a link, 
where the bandwidth constrained frame rate is the rate 
at which frames may be transferred from the imager; 
and 

determining whether the computed bandwidth con- 
strained frame rate is smaller than a frame rate 
requested from the imager, and if so, determining an 
integration time of pixels of the imager from the 
computed bandwidth constrained frame rate. 

2. The method of claim 1, wherein the integration time is 
determined to result in the imager outputting video frames at 
a rate commensurate with the bandwidth constrained frame 
rate. 

3. The method of claim 1, wherein the bandwidth con- 
strained frame rate is computed also from a compression 
ratio of the imager. 

4. The method of claim 1, wherein the integration time is 
determined also from a numerical inverse of the computed 
bandwidth constrained frame rate. 

5. Tbe method of claim 1, further comprising: 
determining a gain of the imager from the determined 

integration time. 

6. An article comprising: a storage medium, the storage 
medium having stored thereon instructions, which, when 
executed by a computing device, result in: 

computing a bandwidth constrained frame rate from a 
frame size of a video camera and a bandwidth of a link, 
where the bandwidth constrained frame rate is the rate 
at which frames may be transferred from the imager; 
and 

determining whether the computed bandwidth con- 
strained frame rate is smaller than a frame rate 
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requested from the camera, and if so, determining an software for determining whether the computed band- 
integration time of pixels of the camera from the width constrained frame rate is smaller than a frame 
computed baadwidm constrained frame rate requested from the imager, and if so, for determin- 

7. The article of claim 6, wherein when the instructions , 1 

are executed, the integration time is determined to result in m S aQ integration time of pixels of the imager from the 

the camera output ting video frames at a rate commensurate computed bandwidth constrained frame rate. 

wife the bandwidth constrained frame rate. 12. The image processing station of claim 11, wherein the 

8. The article of claim 6, wherein when the instructions r _ _ . 4 • • 7 . . . ,. . . . 

are executed, the bandwidth constrained frame rate is com- f° ftwarc for determining the integration time determines an 

puted also from a compression ratio of the video camera. integration time to result in the imager outputting video 

9. The article of claim 6, wherein when the instructions i° frames at a rate commensurate with the computed bandwidth 
are executed, further result in: constrained frame rate. 

computing a numerical inverse of the computed band- 13 The image processing station of claim 11, wherein the 

in^S* ^"f^*? r i tC * software for computing the bandwidth constrained frame 

10. The article of claim 6, wherein when the instructions . . , A , 

are executed, further result in: is ratc also ^ a compression ratio of the video imager, 

determining a gain of the camera from the determined 14. The image processing station of claim 11, wherein the 

integration time. software for determining an integration time computes a 

11. An image processing station for coupling to an imager numerical inverse of the computed bandwidth constrained 
by a communication link, the image processing station frame rate. 

comprising: a computer readable storage medium containing 20 

a program for outputting through the link at least one 15. The iniagc pieces^ station of claim 14, wherem the 

operating parameter of the imager, the program comprising program farther comprises: 

software for computing a bandwidth constrained frame software for determining a gain of the imager from the 

rate from a frame size of the imager and a bandwidth a~*-~~:~~a # - ^ 

«f wnt «,h w tK« h a nH»™nh J?nctr,iW f««~ determined integration time. 



of the link, where the bandwidth constrained frame rate 
is the rate at which frames may be transferred from the 
imager; and 
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